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SYSTEM AND METHOD FOR ESTIMATING PREVALENCE 
OF DIGITAL CONTENT ON THE WORLD-WIDE-WEB 



CROSS-REFERENCE TO RELATED APPLICATIONS 
[0001] The present application claims priority from, and incorporates by reference, the 
provisional application for letters patent, number 60/175,665, filed in the United States Patent and 
Trademark Office on January 12, 2000, and provisional application for letters patent, nimiber 
60/231,195, filed in the United States Patent and Trademark Office on September 7, 2000. 

FIELD OF THE INVENTION 

[0002] The present invention relates generally to a system, method, and computer program 
product for tracking and measuring digital content that is distributed on a computer network such as the 
Intemet. More particularly, the present invention relates to a system, method, and computer program 
product that collects online advertisement data, analyzes the data, and uses the data to calculate 
measurements of the prevalence of those advertisements. 

BACKGROUND OF THE INVENTION 
[0003] The increase in the popularity of the Intemet and the World- Wide- Web ("Web") is due, 

in part, to the interactive technologies that a Web page can employ. These interactive technologies 
directly affect the Web as an advertising medium because the technologies introduced new advertising 
formats such as fixed icon sponsorship advertisements, rotating banners and buttons, and interstitial 
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advertisements (i.e., online advertisements that interrupts the user's work and takes over a significant 
percentage of the screen display). Even though the creation of the advertisement is different, the affect 
on the viewer is similar to traditional advertising. For example, a banner advertisement or logo icon on 
a Web page creates an impression of the product for the viewer that is equivalent to a traditional 
billboard advertisement that promotes a product by presenting the brand name or slogan. Similarly, a 
sponsor's logo on a Web page creates an impression of the sponsor for the viewer that is equivalent to 
seeing a sponsor logo on the scoreboard at a college basketball game. 

[0004] The rapid and volatile growth of the Intemet over the last several years has created a high 
demand for quality statistics quantifying its magnitude and rate of expansion. Several traditional 
measurement methodologies produce useful statistics about the Intemet and its users, but the 
complexity of the Intemet has left some of these methodologies unable to answer many important 
questions. 

[0005] Online advertising is one area where traditional methodologies do not lend well to 

measurement. Each day, thousands upon thousands of electronic advertisements appear and then 
disappear from millions of Web pages. The transitory nature of online advertising activity warrants a 
novel methodology to accurately measure advertising activity. 

[0006] Existing advertisement tracking and measurement systems automate the collection of 
Web pages, but fail to automate the collection of the online advertisements. Since the content of an 
online advertisement changes or rotates over time, accurate reconstraction of the frequency of specific 
advertisements requires continuous sampling of relevant Web pages in the correct proportions. 
Furthermore, due to the sheer size of the Web, sampling algorithms must be finely tuned to optimize 
the allocation of resources (i.e., network bandwidth, database storage, processor time, etc.) and 
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simultaneously enable maximum Internet coverage. The existing advertisement tracking and 
measurement systems fail to meet these needs because they are not optimized for resource allocation 
and do not continuously sample relevant Web pages in the correct proportion. 

[0007] In view of the deficiencies of the existing systems described above, there is a need for an 
advertisement tracking and measurement system that uses resources more intelligently, is friendlier to 
the Web sites that it visits, is scalable, and produces accurate measurements. The invention disclosed 
herein addresses this need. 

SUMMARY OF THE INVENTION 

[0008] The present invention is a system, method, and computer program product for tracking 
and measuring digital content that is distributed on a computer netv^ork such as the Intemet. The 
system collects online advertisement data, analyzes the data, and uses the data to calculate 
measurements of the prevalence of those advertisements. 

[0009] In the preferred embodiment, traffic data from a variety of sources and complimentary 

methodologies fuels the traffic analysis system, an intelligent agent (i.e., software that interact with, 
leam from, and adapt to an environment). The traffic analysis system processes raw traffic data by 
cleansing and summarizing the traffic data prior to storing the processed data in a database. When the 
statistical summarization system calculates the advertising frequency, impressions, and spending, it 
relies upon the processed data from the traffic analysis system. 

[0010] The advertisement sampling system, also known as the "prober" or "Cloudprober", uses a 
robust methodology that continually seek out the most significant and influential Web sites to probe 
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(i.e., monitor). Moreover, the site selection and definition performed by the present invention dictates 
the Web pages that comprise each Web site to ensure that complete, singularly branded entities are 
reported as such. The advertisement sampling system uses intelligent agent technology to retrieve Web 
pages at various frequencies to obtain a representative sample. This allows the Cloudprober to 
accurately assess how frequently each advertisement appears in the traffic data. After the Cloudprober 
fetches a Web page, the advertisement sampling system extracts the advertisements from the Web page, 
hi the preferred embodiment, the advertisement extractor, also known as the "extractor", invokes an 
automatic advertisement detection ("AAD") process, a heuristic extraction process, to automatically 
extract all of the advertisements from the Web page. 

[0011] Following extraction of the advertisements from the Web page, the advertisement 
sampling system invokes a classification engine to analyze the advertisement fragments. The classifier 
processes each fragment to determine a classification for the fragment and then stores the fragment and 
classification data in a database. The result of the analyses and processing performed by the 
advertisement sampling system is a rich catalog of advertising activity that can be easily queried by a 
client. 

[0012] The present invention uses a Web front end and user interface to access and update the 

data in the database. The Web front end provides a client, or user, of the present invention with a query 
interface to the database populated by the traffic analysis, advertisement sampling, and the statistical 
summarization systems. The user interface is a graphical user interface that includes a separate 
component for system account management, site administration, taxonomy administration, advertising 
content classification, and rate card collection. The user interface allows an account manager and 
operator to maintain and administer the present invention. The user interface also allows a media editor 
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to review the data in the database to verify the accuracy and integrity of the vast amount of data 
collected by the present invention. This data integrity process routinely investigates unusual or 
outlying data points to calibrate the system and adapt it to an ever-changing environment. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0013] The accompanying figures best illustrate the details of the present invention, both as to its 
structure and operation. Like reference numbers and designations in these figures refer to like 
elements. 

[0014] Figure 1 is a network diagram depicting the environment for an advertising prevalence 
system according to the present invention. 

[0015] Figure 2 depicts the network diagram of Figure 1, in greater detail, to show the 
relationships between the network environment and the elements that comprise the advertising 
prevalence system. 

[0016] Figure 3 depicts the network diagram of Figure 2, in greater detail, to show the elements 
and sub-elements that comprise the advertising prevalence system and the connections to the network 
environment. 

[0017] Figure 4 A is an exemplary Web site that illustrates the expected values used in the 
calculation of the advertising prevalence statistics. 

[0018] Figure 4B is an exemplary Web site that illustrates the observed values used in the 
calculation of the advertising prevalence statistics. 

[0019] Figure 4C is an exemplary Web site that illustrates the weighted values used in the 

calculation of the advertising prevalence statistics. 
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[0020] Figure 4D is an exemplary Web site that illustrates an alternative method for the 
calculation of the advertising prevalence statistics. 

[0021] Figure 5 illustrates an example of a database structure that the advertising prevalence 
system may use. 

[0022] Figure 6 is a functional block diagram of the advertising prevalence system that shows 
the configuration of the hardware and software components. 

[0023] Figure 7A is a flow diagram of a process in the advertising prevalence system that 
measures the quality of online advertising and the activity generated by an online advertisement. 

[0024] Figure 7B is a flow diagram that describes, in greater detail, the process of sampling 
traffic data from Figure 7A. 

[0025] Figure 7C is a flow diagram that describes, in greater detail, the process of generating a 
probe map based on sampled traffic data from Figure 7A. 

[0026] Figure 7D is a flow diagram that describes, in greater detail, the process of probing the 
Internet to gather sample data from Figure 7A. 

[0027] Figure 7E is a flow diagram that describes, in greater detail, the process of classifying the 
advertising data from Figure 7A. 

[0028] Figure 7F is a flow diagram that describes, in greater detail, the process of calculating 
advertising statistics from Figure 7A. 

DETAILED DESCRIPTION OF THE INVENTION 
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[0029] Figure 1 depicts the environment for the preferred embodiment of the present invention 
that includes the Internet 100, and a Web site 110, traffic sampling system 120, advertising prevalence 
system 130, and client 140. The present invention uses intelligent agent technology to gather data 
related to the attributes, placement, and prevalence of online advertisements. This data provides a user 
with up-to-date estimates of advertisement statistics and helps the user to gain a competitive advantage. 

[0030] As shov^n in Figure 1, the Internet 100 is a public communication network that allows the 
traffic sampling system 120 and advertising prevalence system 130 to conununicate with a client 140 
and a Web site 1 10. Even though the preferred embodiment uses the Internet 100, the present invention 
contemplates the use of other public or private network architectures such as an intranet or extranet. 
An intranet is a private communication network that functions similar to the Internet 100. An 
organization, such as a corporation, creates an intranet to provide a secure means for members of the 
organization to access the resources on the organization's network. An extranet is also a private 
communication network that functions similar to the Internet 100. In contrast to an intranet, an extranet 
provides a secure means for the organization to authorize non-members of the organization to access 
certain resources on the organization's network. The present invention also contemplates using a 
network protocol such as Ethemet or Token Ring, as well as, proprietary network protocols. 

[0031] The traffic sampling system 120 is a program that monitors and records Web activity on 

the Internet 100. The traffic sampling system 120 is an intermediary repository of traffic data between 
a Web surfer (not shown) on the Internet 100 and a Web server 112. The Web server 112 shown in 
Figure 1 is a conventional personal computer or computer workstation that includes the proper 
operating system, hardware, communications protocol (e.g.. Transmission Control Protocol/Internet 
Protocol), and Web server software to host a collection of Web pages. The Web surfer (not shown) 
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communicates with the Web server 1 12 by requesting a Uniform Resource Locator ("URL") 114, 116, 
1 18 associated with the Web site 110, typically using a Web browser. Any program or device that can 
record a request for a URL made by a Web surfer (not shown) to a Web server 112 can perform the 
functions that the present invention requires of the traffic sampUng system 120. The traffic samphng 
system 120 then aggregates the traffic data for each Web site 1 10 for use by the advertising prevalence 
system 130. 

[0032] The present invention can use any commercially available traffic sampling system that 
provides functionality similar to the Media Metrix audience measurement product. Other possible 
mechanisms to obtain a traffic data sample include: 

1 . "Proxy Cache Sampling" gathers data such as user clickstream data, and Web page 
requests from a global distributed hierarchy of proxy cache servers. This data passes through an 
intermediate mechanism that provides pre- fetch and caching services for Web objects. As of 
May 1999, traffic statistics calculated by the present invention represent the distillation of raw 
data from nine first-tier and approximately 400 second-tier caches in the United States, as well as 
an additional 1 1 00 worldwide. 

2. "Client-Side Panel Collection" retrieves sample data from each panelist via a chent-side 
mechanism and transfers that data to a collection repository. The client-side mechanism may 
monitor the browser location bar, user browser, a client-side proxy, or TCP/IP stack hooks. 

3. A "Transcoder" is a proxy that rewrites HTML, usually for the purpose of adding 
elements for generation of advertisement revenue or page headers/footers. Free Litemet service 
providers ("ISPs") typically use this technique. 
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4. Any content distribution mechanism that rephcates Web page or site content in a manner 
meant to ease network congestion or improve user experience. 

5. Any content filtering mechanism that evaluates requests for URLs and takes actions to 
allow or disallow such requests. 

6. From server logs maintained by Intemet service providers ("ISPs") or individual Web 
sites. 

[0033] Figure 2 expands the detail of the advertising prevalence system 130 in Figure 1 to show 
the relationships between the network environment and the elements that comprise the advertising 
prevalence system 130. The advertising prevalence system 130 includes a traffic analysis system 210, 
advertisement sampling system 220, and statistical summarization system 230 that communicate data to 
the database 200 for storage. The account manager 260, operator 262, and media editor 264 can access 
the database 200 through the user interface 240 to perform administrative functions. The client 140 can 
access the database 200 through the Web front end 250. 

[0034] The traffic analysis system 210 receives raw traffic data from the traffic sampling system 
120. The traffic analysis system 210 cleanses the raw traffic data by removing information from the 
traffic data that may identify a particular user on the Intemet 100 and then stores the anonymous data in 
the database 200. The traffic analysis system 210 estimates the global traffic to every significant Web 
site on the Intemet 100. The present invention uses this data not only for computing the number of 
advertising impressions given an estimate of the frequency of rotation on that page, but also in the 
probe mapping system 320. In one embodiment, the traffic analysis system 210 receives traffic data 
from a cache site on the Intemet 100. The goal is to accurately measure the number of page views by 
individual users, and therefore the number of advertising impressions. 
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[0035] The advertisement sampling system 220 uses the anonymous traffic data to determine 

which URLs to include in the sample retrieved from the Web server 1 12. The advertisement sampling 
system 220 contacts the Web server 112 through the hitemet 100 to retrieve a URL 114, 116, 118 and 
extract the advertisements therein along with the accompanying characteristics that describe the 
advertisements. The success rate for retrieval of creatives is high. Analysis indicates that the present 
invention captures over 95% of creatives served. The advertisement sampling system 220 stores these 
advertisement characteristics in the database 200. The advertisement sampling system 220, for 
example, Online Media Network Intelligent Agent Collection ("OMNLVC"), or the Cloudprober, 
repeatedly probes prominent. Web sites, extracts advertisements from each Web page returned by the 
probe, and classifies the advertisements in each Web page by type, technology and advertiser. 

[0036] The traffic analysis system 210 and the advertisement sampling system 220 also present 

the data retrieved from the Internet 100 to the statistical summarization system 230 for periodic 
processing. The statistical summarization system 230 calculates the advertising frequency, 
impressions, and spending on a per site and per week basis. 

[0037] The graphical user interface for the present invention includes the user interface 240 and 
Web front end 250. The account manager 260, operator 262, and media editor 264 access the user 
interface 240 to administer access by the client 140 to the Web front end 250 (e.g., account and 
password management), define sites and probe instructions, and manage the advertising taxonomy, 
content classification, and rate card collection for the advertising prevalence system 130. The Web 
front end 250 is the Web browser interface that a client 140 uses to retrieve the advertisement 
measurement results from the database 200 as generated by the traffic analysis system 210, 
advertisement sampling system 220, and the statistical summarization system 230. 
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[0038] Figure 3 further expands the detail of the advertising prevalence system 130 to depict the 
logical components comprising the elements of the advertising prevalence system 130 shown in Figure 
2. Figure 3 also depicts the relationships between the network environment and those logical 
components. 

[0039] The traffic analysis system 210 includes an anonymity system 310 and traffic 
summarization 312 process. 

[0040] The anonymity system 310 cleanses the data received from the traffic sampling system 
120 by removing information that identifies a particular user on the Internet. The data is rendered 
anonymous by passing all user information (e.g., originating internet protocol ("IP") number or 
cookies) through a cryptographically secure one-way hash fimction; this assures the utmost privacy for 
Web users without devaluing the resulting data. The anonymity system 310 presents the cleansed data 
to the traffic summarization system 312 which in turn stores the aggregated URL count information in 
database 200. 

[0041] The traffic summarization process 312 receives cleansed data from the anonymity system 
310. The anonymous traffic data is summarized to yield traffic totals by week or month for individual 
URLs, domains, and Web sites. The traffic summarization process 312 scales the data by weighting 
factors to extrapolate total global traffic from the sample. 

[0042] The advertisement sampling system 220 in Figure 3 includes a probe mapping system 

320, Web page retrieval system 322, Web browser emulation environment 324, advertisement extractor 
326, and a structural classifier 328. 

[0043] The probe mapping system 320 generates a probe map, i.e., the URLs 114, 116, 118 that 

the advertisement sampling system 220 will visit. This probe map assists the advertisement sampling 
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system 220 with the measurement of the rotation of advertisements on individual Web sites. The 
preferred embodiment of the present invention continuously fetches various Web pages in the probe 
map. In an alternative embodiment, the present invention visits each URL in the probe map 
approximately every 6 minutes. Another embodiment can vary the fetching rate by considering several 
factors including the amount of traffic that visits the Web site as a v^hole and the individual Web page 
in question, the number of advertisements historically seen on the Web page, and the similarity of the 
historically observed ad rotation to other sampled pages. 

[0044] The Web page retrieval system 322 uses the probe map generated by the probe mapping 
system 320 to determine which Web pages it needs to sample and the frequency of the sampling. For 
each URL in the probe map generated by the probe mapping system 320, the Web page retrieval system 
322 fetches a Web page, extracts each advertisement from the Web page, and stores the advertisement's 
attributes in the database 200. The data retrieved from each URL in the probe map is used to calculate 
the frequency with which each advertisement is shown on a particular Web site. 

[0045] For each Web page, the Web browser emulation environment 324 simulates the display 
of the Web page in a browser. This simulation guarantees that the present invention will detect not 
only static advertisements, but also dynamic advertisements generated by software programs vmtten in 
a language such as JavaScript, Perl, Java, C, C++, or HTML that can be embedded in a Web page. 

[0046] The advertisement extractor 326 extracts the online advertisements from the result of the 
simulation performed by the Web browser emulation environment 324. The advertisement extractor 
326 identifies features of the advertising content (i.e., "fragments") extracted from the Web pages 
returned by the probe mapping system 320 that are of particular interest. Advertisements are the most 
interesting dynamic feature to extract, however, an alternative embodiment of the present invention 
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may use the extraction technology to collect any type of digital content including promotions, surveys, 
and news stories. The advertisement extractor 326 can use various advertisement extraction methods, 
including rule-based extraction, heuristic extraction, and comparison extraction. 

[0047] Rule-based extraction relies upon a media editor 264 to use the user interface 240 to 
create rules. The user interface 240 stores the rules in the database 200 and the advertisement extractor 
326 applies the rules to each Web page that the Web page retrieval system 322 retrieves. The effect of 
running a rule is to identify and extract an HTML fragment from the Web page (i.e., the part of the 
page containing the advertisement). The advertisement extractor 326 first converts the HTML 
representation of the fetched Web page into a well-formed XML representation. Following this 
conversion, the rules are applied to the parse tree of the XML representation of the Web page. 

[0048] Heuristic extraction relies upon the similarity of advertisements at the HTML or XML 
source code level because the advertisements are typically inserted by an advertisement server when the 
Web page is generated in response to the Web browser emulation environment 324 request to display 
the Web page. Heuristic extraction analyzes the source code for clues (e.g., references to the names of 
known advertisement servers) and extracts fragments that surround those clues. The advantage of this 
method is that the extraction is automatic and the media editor need not create the rules. 

[0049] Comparison extraction repeatedly fetches the same Web page. This extraction method 

compares the different versions of the Web page to determine whether the content varies from version 
to version. The portion of the Web page that varies with some degree of frequency is usually an 
advertisement and is extracted. 

[0050] The structural classifier 328 parses each advertisement and stores the structural 
components in the database 200 and passes those components to the statistical summarization system 
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230. Each advertisement fragment extracted by the advertisement extractor 326 is analyzed by the 
structural classifier 328. The process performed by the structural classifier 328 comprises duplicate 
fragment elimination, structural fragment analysis, duplicate advertisement detection. The structural 
classifier 328 performs duplicate fragment elimination by comparing the current advertisement 
fragment to other fragments in the database 200. Two advertisement fragments are duplicates if the 
fragments are identical (e.g., each fragment has the exact same HTML content). If the structural 
classifier 328 determines that the current fragment is a duplicate of a fragment in the database, the 
advertisement sampling system 220 logs another observation of the fragment and continues processing 
fragments. 

[0051] The structural classifier 328 performs structural fragment analysis on the XML 

representation of the Web page by determining the "physical type" of the fragment (i.e., the HTML 

source code used to construct the advertisement). Physical types that the present invention recognizes 

include banner, form, single link, and embedded content. Banner advertisement fragments include a 

single HTML link having one or two enclosed images and no FORM or IFRAME tag. Form 

advertisement fragments include a single HTML form having no IFRAME tag. Single link 

advertisement fragments include a link with textual, but no IMG, FORM, or IFRAME tags. Embedded 

content advertisement fragments reference an external entity using an IFRAME tag. After performing 

this analysis, the structural classifier 328 updates the advertisement fragment in the database. For a 

banner advertisement fragment, the structural classifier 328 stores the link and image URL's in the 

database 200. A form advertisement fragment requires the creation of a URL by simulating a user 

submission that sets each HTML control to its default value. The structural classifier 328 stores this 

URL and the "form signature" (i.e., a string that uniquely describes the content of all controls in the 

form) in the database 200. For a single text advertisement fragment, the structural classifier 328 stores 
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the URL for the Unk and all text contained within the Hnk in the database 200. For embedded content 
advertisement fragments, the structural classifier 328 stores the URL associated with the external 
reference in the database 200. This URL is loaded by the system, and the referenced document is 
loaded. Once the loaded document has been structurally analyzed, the original fragment inherits any 
attributes that result from analysis of the new fragment. 

[0052] The structural classifier 328 performs duplicate advertisement detection on each 
advertisement fragment that has a known physical type because these fragments represent 
advertisements. Each unique advertisement has information, including which site definitions are 
associated with the fragment, stored in the database 200. The structural classifier 328 determination of 
uniqueness depends on different criteria for each type of fragment. The first step for every type of 
definition is to resolve all URLs associated with the record. URLs that refer to images are loaded, and 
duplicate images are noted. HTML link URLs, also known as "chck URLs", are followed each time a 
new ad is created. The final destination for a click URL, after following all HTTP redirects, is noted. 
This is also done for simulated link submission URLs associated with form definitions. Once all URLs 
have been resolved, the structural classifier 328 determines whether the advertisement is unique. 
Banner advertisement fragments are considered unique if they have the same nimiber of images, if the 
images are identical, and if the destination URL is identical. Form advertisement fragments are 
considered unique if they have the same signature, and the same destination URL. Single link 
advertisement fragments are considered unique if they have the same textual content and the same 
destination URL. 

[0053] The statistical summarization system 230 calculates the advertisement statistics for each 

unique advertisement in the database 200. The present invention calculates, for each Web site, the 

advertising impressions (i.e., the number of times a human being views an advertisement). The present 
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invention calculates the advertising impressions, I, using the formula I = T x R, where T is the traffic 
going to the site, and R is the rotation of advertisements on that site. The present invention also 
calculates the spending, S, using the formula S = I x RC, v^here I is the advertising impressions for a 
Web site, and RC is the rate code for the Web site. Most advertising buys are complicated deals v^ith 
volume purchasing discounts so our numbers do not necessarily represent the actual cost of the total 
buy. 

[0054] The Web front end 250 is a graphical user interface that provides a client 140 with a 

query interface to the database 200 populated by the traffic analysis system 210, advertisement 
sampling system 220, and the statistical summarization system 230. The chent 140 can use the Web 
front end 250 to create, store, edit and download graphical and tabular reports for one or more industry 
categories depending on the level of service the client 140 selects. 

[0055] The user interface 240 in Figure 3 includes a separate component for system account 

management 340, site administration 342, taxonomy administration 344, advertising content 
classification 346, and rate card collection 348. 

[0056] The account manager 260 uses the system account management 340 module of the user 
interface 240 to simplify the administration of the Web front end 250. The account manager 260 uses 
the system account management 340 module to create and delete user accounts, manage user account 
passwords, and check on the overall health of the Web front end 250. 

[0057] The operator 262 uses the site administration 342 module of the user interface 240 to 

simplify the administration of the site definitions. Analysts from the Internet Advertising Bureau 
estimate that over 90% of all Web advertising dollars are spent on the top fifty Web sites. Site 
selection begins by choosing the top 100 advertisements by considering data from Media Metrix, 
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Neilsen/Net Ratings, and the proxy traffic data in the database 200. These lists are periodically updated 
to demote Web sites with low traffic levels and promote new sites with high traffic levels. The present 
invention also includes Web sites that provide significant content in key industries. A site chosen for 
inclusion in the site definitions must have the structure of the site analyzed to remove sections that do 
not serve advertisements, originate from foreign countries, or are part of a frame set. Sites that 
originate from a foreign country, such as yahoo.co.jp, sell advertising in the host country, and therefore 
are not applicable to the measurements calculated by the present invention. Web sites that use an 
HTML frameset are treated very carefrilly to only apply rotation rates to the traffic from the sections of 
the frameset that contain the advertisement. These combined exclusions are key to making accurate 
estimates of advertising impressions. The present invention also tags sections that cannot be measured 
directly, due to registration requirements (e.g., mail pages). Since Web sites change frequency, this 
structural analysis is repeated periodically. Eventually the analysis stage will automatically flag altered 
sites to allow even more timely updates. 

[0058] The media editor 264 uses the taxonomy administration 344, advertising content 

classification 346, and rate card collection 348 modules of the user interface 240. The taxonomy 
administration 344 module simplifies the creation and maintenance of the attributes assigned to 
advertisements during content classification including the advertisement's industry, company, and 
products. The taxonomy names each attribute and specifies its type, ancestry and segment 
membership. For example, a company Honda, might be parented by the Automotive industry and 
belong to the industry segment Automotive Manufactures. The advertising content classification 346 
component assists the media editor 264 with performing the content classification. 

[0059] The structural classifier 328 performs automated advertisable assignment to determine 

what the advertisement is advertising. This process includes assigning "advertisables" (i.e., attributes 
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describing each "thing" that the advertisement is advertising) to each advertisement fragment. In 
another embodiment of the present invention, the advertisement sampling system 220 uses an 
extensible set of heuristics to assign advertisables to each advertisement. In the preferred embodiment, 
however, the only automatic method employed is location classification. Location classification relies 
on the destination URL in order to assign a set of advertisables to an advertisement. A media editor 
264 uses the user interface 240 to maintain the set of classified locations. For example, the first time a 
media editor observes an advertisement in which the click-thru URL is www.honda.com, he can enter 
this URL as pertaining to the advertiser "Honda Motors". Any subsequent advertisement that includes 
the same click-thru URL will also be recognized as a Honda advertisement. A classified location 
comprises a host, URL path prefix, and set of advertisables. Location classification assigns a classified 
location advertisable to an advertisement if the host in the destination URL matches the host of the 
classified location and the path prefix in the classified location matches the beginning of the path in the 
destination URL. 

[0060] The structural classifier 328 performs human advertisable assignment and verification as 
a quality check of the advertisable data. This phase is the most human intensive. A media editor 264 
uses a graphical user interface module in the user interface 240 to display each advertisement, verify 
automatic advertisable assignments, and assign any other advertisables that appear appropriate after 
inspection of the advertisement and the destination of the advertisement. The location classification 
database is also typically maintained at this time. 

[0061] The media editor 264 uses the rate card collection 348 module to enter the contact and 

rate card information for a Web site identified by the traffic analysis system 210, as well as, designated 

advertisers. Rate card entry includes the applicable quarter (e.g., Q4 2000), advertisement dimensions 

in pixels, fee structure (e.g., CPM, flat fee, or per click), cost schedule for buys of various quantities 
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and duration. The media editor 264 also records the URL address of the online media kit and whether 
rates are published therein. Contact information for a Web site or advertiser includes the homepage, 
name, phone and facsimile numbers, email address, and street address. 

[0062] Figures 4A through 4C illustrate the preferred method for calculating the advertising 
prevalence statistics. The calculation of the advertising prevalence statistics is an iterative process that 
uses expected values derived by the traffic analysis system 210 and observed values derived by the 
advertising prevalence system 220 to calculate the weighted values and the advertising prevalence 
statistics. Figures 4A through 4C each depict a network on the Intemet 100 that includes two Web sites 
served by Web server P 410 and Web server Q 420. Figure 4A illustrates exemplary expected traffic 
values for the network. Figure 4B illustrates exemplary observed traffic values for the network. Figure 
4C illustrates exemplary weighted traffic values for the network. 

[0063] The first step in the process is to normalize the results from the traffic analysis system 

210. The traffic analysis system 210 provides the traffic received by each Web page in the traffic data 

sample. Figure 4A depicts the exemplary traffic received at each Web page 411-416, 421-424 in the 

Intemet 100 with the label "Traffic =.'* The probe map generated by the probe mapping system 320 

includes an entry for each Web page 411-416, 421-424. The probe map also includes an "area" that 

each Web page 411-416, 421-424 consumes in the probe map. Figure 4A depicts the exemplary area 

that each Web page 411-416, 421-424 consumes in the probe map with the label "Area =". The 

normalized results are calculated by dividing the area that a Web page consumes in the probe map by 

the sum of the area for each Web page in the traffic sample. In Figure 4A, the normalized value, or 

chance, for Web page PI 41 1 is the area for Web page PI (i.e., 15) divided by the sum of the area for 

Web page PI, P2, P3, P4, P5, P6, Ql, Q2, Q3, and Q4 (i.e., 120). The normalized value is, therefore, 

0.125, or 12.5%. In addition to the normalized value, the system also determines the scale by dividing 
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the traffic for a Web page by the area for the Web page. In Figure 4A, the scale for Web page PI 41 1 
is the traffic for Web page PI (i.e., 150) divided by the area for Web page PI (i.e., 15), therefore, the 
scale for Web page PI is 10. Table 1 summarizes the scale and chance values for the remaining Web 
page in Figure 4A. 



Web Page 


Area 


Scale 


Chance 


Ti 1 
PI 


15 


10 


12.5% 


P2 


1 A 

10 


1 


o on/ 

8.3% 




1 A 

14 


1 


12% 


P4 


12 


0.25 


10% 


P5 


8 


0.5 


6.7% 


P6 


4 


1 


3.3% 


Ql 


30 


0.5 


25% 


Q2 


4 


0.5 


3.3% 


Q3 


15 


2 


12.5% 


Q4 


8 


0.5 


6.7% 



Table L 

[0064] Figure 4B depicts the exemplary Web page fetches at each Web page 411-416, 421-424 
in the Internet 100 with the label "Fetches Figure 4B also depicts the exemplary number of views 
of each advertisement on a Web page 411-416, 421-424 with a label such as "Al Views =" to indicate 
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the number of views of advertisement Al, "A2 Views - ' to indicate the number of views of 
advertisement A2, etc. 

[0065] Figure 4C depicts the exemplary Web page weighted fetches at each Web page 411-416, 
421-424 in the Internet 100 with the label "Fetches - *. Figure 4C also depicts the exemplary number 
of views of each advertisement on a Web page 411-416, 421-424 with a label such as "Al Views =" to 
indicate the number of views of advertisement Al, "A2 Views =" to indicate the number of views of 
advertisement A2, etc. The next step in the calculation process is to calculate the Scaled Fetches for 
each Web site 410, 420 by summing the product of the observed fetches from Figure 4B and the scale 
from Figure 4 A, for each Web page 411-416, 421-424 in the Web site. Next, the calculation computes 
the Traffic for each Web site 410, 420 by summing the traffic from Figure 4 A for each Web page 411- 
416, 421-424 in the Web site. The rate card, or CPM, is a value assigned by the media editor 264 for 
each Web site 410, 420. Table 2 summarizes the Scaled Fetches, Traffic, and CPM for Figures 4A 
through 4C. 



Site 


Scaled Fetches 


Traffic 


CPM 


P 


193.5 


185 


$35.00 


Q 


43 


51 


$50.00 



Table 2. 

[0066] The next step in the calculation process is to compute the Scaled Observations for each 

advertisement on each Web site 410, 420 by summing the product of the advertisement views from 

Figure 4B and the scale from Figure 4A, for each Web page 41 1-416, 421-424 in the Web site 410, 

420. The final step in the calculation is to compute the advertising prevalence statistics (i.e., 

Frequency, Impressions, and Spending) for each advertisement in each Web site 410, 420. Frequency 

is computed by dividing the scaled observations by the scaled fetches for each advertisement in each 
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Web site 410, 420. Impressions is computed by multiplying the Frequency by the Traffic from Table 2 
above for each advertisement in each Web site 410, 420. Spending is computed by multiplying the 
Impressions by the CPM from Table 2 above for each advertisement in each Web site 410, 420. Table 
3 summarizes the Scaled Observations, Frequency, Impressions, and Spending for Web site P 410 
using the data in Figures 4A through 4C. Table 4 summarizes the Scaled Observations, Frequency, 
Impressions, and Spending for Web site Q 420 using the data in Figures 4A through 4C. 





Scaled Observations 


Frequency 


Impression 


Spending 


Al 


55.0 


0.28 


52.58 


$1.84 


A2 


85.0 


0.44 


81.27 


$2.84 


A3 


6.0 


0.03 


5.74 


$0.20 


A4 


3.5 


0.02 


3.35 


$0.12 


A5 










Table 3. 












Scaled Observations 


Frequency 


Impressions 


Spending 


Al 


29.5 


0.69 


34.99 


1.75 


A2 


12.0 


0.28 


14.23 


0.71 


A3 


12.0 


0.28 


14.23 


0.71 


A4 


12.0 


0.28 


14.23 


0.71 


AS 


1.5 


0.03 


1.78 


0.09 



Table 4. 



[0067] Figure 4D illustrates an alternative embodiment for calculating the advertising prevalence 
statistics. In this embodiment, the prober is tuned to optimize rotation measurement accuracy. 
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Statistical estimates of accuracy in the field are difficult to perform, due to the non-stationary nature of 
advertising servers. When probing every 6 minutes, it has a 0.06% resolution in rotational fi'equency 
over a one-week measurement period. 

[0068] Also in the alternative embodiment of Figure 4D, the probes are distributed among the 
sites to accurately measure ad rotation on each site. The number of probing URLs assigned to a site is 
determined from three variables. The first is a constant across all sites; a certain number of probing 
URLs are required to accurately measure rotation on even the smallest site. Half of the probes are 
assigned with this variable. The second variable, weighted at 40%, is the amount of traffic going to a 
site, as each probing URL represents a proportion of total Internet traffic. The twenty largest sites 
receive over 75% of these probes. Finally the complexity of site, as measured by the total number of 
unique URLs found in our proxy traffic data, is taken into account, with more complicated sites 
receiving extra probing URLs. This accounts for the remaining 10% of the probe distribution. Probing 
URLs can be chosen using a Site Shredder algorithm to break the site into regions (i.e., sets of pages 
whose advertisement rotation characteristics are likely to be similar) for probing. The distribution of 
regions is mathematically designed to maximize site coverage and, therefore, advertisement rotation 
accuracy. A single URL is chosen to represent the advertising rotation fi-om each region. This URL is 
chosen as the most heavily trafficked page containing advertisements in that region. The algorithm 
avoids date specific pages or pages referring to a time-limited event such as the August 1999 total lunar 
eclipse. 

[0069] The alternative embodiment of Figure 4D calculates advertisement impressions by 

combining the estimates of rotation and traffic for each Web site 430. To do this the system breaks the 

site down into its constituent stems using the Site Shredder algorithm. The rotation of advertisements 

in each advertisement slot is calculated and applied to estimate advertising impressions on its 
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associated stem. The advertisement rotation on stems without probes is estimated from an average, 
weighted by traffic, of advertisement rotation of probes on a similar level. 

[0070] For instance, in Figure 4D, the sample site tree has five probes URLs 431-435, P1-5, 
placed on five main branches off a main page and 14 secondary branches. The number on each page is 
the sample traffic going to that page. Probe Pi on the home page, "www.testsite.com", measures the 
rotation, R, to be applied to the traffic going to that main page, with traffic of 88 page views. Branch A 
has a single probe, P2, placed on the top-level page of that branch with a probing URL 
"wvvw.testsite.com/ A/". The rotation of this single probing URL is estimated as Ra and is applied to 
the traffic for that entire stem, a total of 21 page views. Branch C has a probe, P3, on a heavily 
trafficked secondary branch page, with a probing URL "www.testsite.com/C/third.html". The rotation, 
Rc, of this page is applied to all the secondary branch pages on that stem and also up one level in the 
tree, across a total of 25 page views. Branch E receives a large portion of the traffic for the site, a total 
of 61 page views, and therefore is assigned two probes, P4 and P5. These are on two secondary branch 
pages, "www.testsite.com/E/first.html" and "www.testsite.com/E/third.html". The rotation of each is 
applied the traffic to those individual pages. For the remaining 18 page views on that branch (ten page 
views from two secondary pages and eight from the top level page of that branch) a weighted rotation is 
calculated, Re ((13 x Rei) + (30 x Re3))/( 13+30). The analysis of stem rotation results in advertising 
impressions for over 96% of the site. The impressions for the final two branches, B and D, are 
calculated with an average rotation from adjacent branches, weighted by traffic. 



Rb = Rd= ((21 X Ra) + (25 x Rc) + (61 x Re)) - (21 + 25 + 61). 



NY2- 429233.01 



25 



[0071] This analysis results in total impressions across the site for each unique advertisement. 
The final calculation performed by the alternative embodiment of Figure 4D is spending, the product of 
the hnpressions and the Rate Card. 

[0072] Figure 5 illustrates a database structure that the advertising prevalence system 130 may 
use to store information retrieved by the traffic sampling system 120 and the Web page retrieval system 
322. The preferred embodiment segments the database 200 into partitions. Each partition can perform 
fiinctions similar to an independent database such as the database 200. In addition, a partitioned 
database simplifies the administration of the data in the partition. Even though the preferred 
embodiment uses database partitions, the present invention contemplates consolidation of these 
partitions into a single database, as well as making each partition an independent database and 
distributing each database to a separate general purpose computer workstation or server. The partitions 
for the database 200 of the present invention include sampling records 510, probing definitions 520, 
advertising support data 530, and advertising summary 540. The preferred embodiment of the present 
invention uses a relational database management system, such as the Oracle^? product by Oracle 
Corporation, to create and manage the database and partitions. Even though the preferred embodiment 
uses a relational database, the present invention contemplates the use of other database architectures 
such as an object-oriented database management system. 

[0073] The sampling records 510 partition of database 200 comprises database tables that are 
logically segmented into traffic data 512, advertisement view logging 514, and advertising structure 
516 areas. 

[0074] The traffic data 512 area contains data processed by the traffic sampling system 120, 

anonymity system 310, and statistical summarization system 230. The data stored in this schema 
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includes a "munged" URL, and the count of traffic each URL receives per traffic source over a period 
of time. A "munged" URL is an ordinary URL with the protocol field removed and the order of the 
dotted components in the hostname reversed. For example, the present invention transforms an 
ordinary URL, such as http://www.somesite.com/food, into a munged URL by removing the protocol 
field (i.e., "http://") and reversing the order of the dotted components in the hostname (i.e., 
"www.somesite.com"). The resulting munged URL in this example is "com.somesite.www/food". The 
present invention uses this proprietary URL format to greatly enhance the traffic data analysis process. 
The traffic sampling system 120 populates the traffic data 512 area in database 200. The probe 
mapping system 320 accesses the data in the traffic data 512 area to assist the Web page retrieval 
system 322 and the statistical summarization system 230 with the calculation of the advertising 
impression and spending statistics. 

[0075] The advertisement view logging 514 area logs the time, URL, and advertisement 
identifier for each advertisement encountered on the Internet 100. This area also logs each time the 
system does not detect an advertisement in a Web page that previously included the advertisement. In 
addition, the system logs each time the system detects a potential advertisement, but fails to recognize 
the advertisement during structural classification. The structural classifier 328 and the Web page 
retrieval system 322 of the advertisement sampling system 220 populate the advertisement view 
logging 514 area in database 200. The statistical summarization system 230 accesses the data in the 
advertisement view logging 514 area to determine the fi-equency that each advertisement appears on 
each site. 

[0076] The advertisement structure 516 area contains data that characterizes each unique 

advertisement located by the system. This data includes the content of the advertisement, 

advertisement type (e.g., image, HTML form, Flash, etc.), the destination URL linked to the 
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advertisement, and several items used during content classification and diagnostics, including where the 
advertisement was first seen, and which advertisement definition originally produced the 
advertisement. The structural classifier 328 component of the advertisement sampling system 220 
populates the advertisement structure 516 area in database 200. The user interface 240 accesses the 
data in the advertisement structure 516 area to display each advertisement to the media editor 264 
during classification editing. The Web fi:*ont end 250 also accesses the data in the advertisement 
structure 516 area to display the advertisements to the client 140. 

[0077] The probing definitions 520 partition of database 200 comprises database tables that are 
logically segmented into site definition 522, probe map 524, and advertisement extraction rule 
definition 526 areas. 

[0078] The site definition 522 area carves the portion of the Internet 100 that the system probes 
into regions. The primary region definition is a "site", a cohesive entity the system needs to analyze, 
sample, and summarize. The system defines each site in terms of both inclusive and exclusive munged 
URL prefixes. A "munged URL prefix" is a munged URL that represents the region of all munged 
URLs for which it is a prefix. An "inclusive munged URL prefix" specifies that a URL is part of some 
entity. An "exclusive munged URL prefix" specifies that a URL is not part of some entity, overriding 
portions of the entity included by an inclusive prefix. To illustrate, the following is list of munged 
URLs that may result fi"om the processing of a set of URLs in a traffic sample. 

1. com.somesite/ 

2. com.somesite/foo 

3. com. somesite/foo/bar 

4. com.somesite/foo/blah 
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5. com. someothersite/ 



[0079] If the site definition for "somesite" includes the inclusive URL prefix "com.somesite/" 
and the exclusive URL prefix "com.somesite/foo/bar", the application of this site definition to the 
above sample URLs listed above yields a system that includes URL 1, 2, and 4. URL 3 is not part of 
the site definition due to the explicit exclusion of "com.somesite/foo/bar". URL 5 is not part of the site 
definition because it was never included in the inclusive URL prefix "com.somesite/". The user 
interface 240 populates the site definition 522 area in database 200. The probe mapping system 320 
accesses the data in the site definition 522 area to determine which URLs to probe. The statistical 
summarization system 230 accesses the data in the site definition 522 area to determine traffic levels to 
sites by summing traffic to URLs included in a site. 

[0080] The probe map 524 area contains a weight for each URL in each site that the system is 

measuring. This weight determines the likelihood that the system will choose a URL for each probe. 

The system generates the weights by running complex iterative algorithms against the traffic data and 

the probing records in the database 200. An analysis of the traffic data can discern which URLs have 

been visited, how often users have visited those URLs. The result of the analysis guarantees that the 

system performs advertisement sampling of these URLs in similar proportions, given certain 

constraints such as a maximum number of probes to allocate to any single URL. The data in the 

sampling records 510 partition of the database 200 is useful for determining which URLs are in need of 

special handling due to past behavior (e.g., a URL is sampled less infrequently if the system has never 

detected an advertisement in the URL). The probe mapping system 320 populates the probe map 524 

areas in the database 200. The probe mapping system 320 accesses the data in the probe map 524 area 

to allocate the probes. The statistical summarization system 230 accesses the data in the probe map 524 
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area to determine which URLs should have their rotations scaled to counter the effect of probe map 
constraint enforcement. 

[0081] The advertisement extraction rule definition 526 area describes Extensible Markup 
Language ("XML") tags, typically representing a normalized HTML document, that indicate those 
portions of the content that the system considers to be advertisements. The system defines an 
extraction rule in terms of "XML structure" and "XML features". "XML structure" refers to the 
positioning of various XML nodes relative to others XML nodes. For example, an anchor ("A") node 
containing an image ("IMG") node is likely an advertisement. After using this structural detection 
process to match the advertisement content, the system examines the features of the content to 
determine if the content is an advertisement. To continue the previous example, if the image node 
contains a link ("href) feature that contains the sub-string "adserver", it is very likely an 
advertisement. Features may match based on a simple sub-string, as in the example, or a more 
complicated regular expression. Another form of extraction rule may point to a specific node in an 
XML structure using some form of XML path specification, such as a "Xpointer". The media editor 
264 populates the advertisement extraction rule definition 526 area in the database 200. The 
advertisement extractor 526 of the advertisement sampling system 220 accesses the data in the 
advertisement extraction rule definition 526 area to determine which portions of each probed page 
represent an advertisement. 

[0082] The advertising support data 530 partition of database 200 comprises database tables that 
are logically segmented into advertisable taxonomy 532, advertising information 534, rate card 536, 
and extended advertisable information 538 areas. 
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[0083] The advertisable taxonomy 532 area contains a hierarchical taxonomy of advertisables, 
attributes that describe what the advertisement is advertising. This taxonomy includes industries, 
companies, products, Web sites, Web sub-sites, messages, etc. Each node in the hierarchy has a type 
that specifies what kind of entity it represents and a parent node. For example, the hierarchy may 
specify that products live within companies, which in tum live within industries. The media editor 264 
populates the advertisable taxonomy 532 area in the database 200. The user interface 240 accesses the 
data in the advertisable taxonomy 532 area to generate statistical data and record where companies, 
industries, etc. tend to advertise. The Web front end 250 also accesses the data in the advertisable 
taxonomy 532 area to display this information to the cHent 140. 

[0084] The advertising information 534 area contains the data that describe what each unique 
advertisement recorded by the system advertises. The tables in the advertising information 534 area 
associate advertisables with advertisements. For example, the system may associate a company type of 
advertisable with a specific advertisement to indicate that the advertisement is advertising the company. 
The system uses the following methods to associate an advertisable with an advertisement: 

1. A "direct classification" assigns an advertisable directly to the advertisement. For example, a 
media editor 264 creates a direct classification by specifying that a particular advertisement 
advertises the "Honda" advertisable. 

2. A "location classification" assigns an advertisable to a location prefix that the system uses to 
match the destination of the advertisement. For example, a media editor 264 creates a location 
classification by specifying that the location "com.honda" indicates an advertisement for Honda. 
An advertisement that points to "com.honda. www/cars", therefore, associates the advertisement 
with Honda. 
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3. An "ancestral classification" assigns an ancestor of the advertisable to an advertisement. For 
example, if a direct classification assigns Honda to an advertisement, the "automotive" industry 
advertisable is a predecessor of Honda. Ancestral classification uses this relationship to associate 
automotive to the advertisement. 
The media editor 264 populates the advertising information 534 area in the database 200. The user 
interface 240 accesses the data in the advertising information 534 area to generate statistical data. 

[0085] The rate card 536 area contains data describing the cost of advertisements on a Web site. 
These costs include monetary values for each specific shape, size, or length of run that advertisers on 
the hitemet 100 use to determine the cost of advertisement purchases. The system stores rate card data 
for each Web site that the system probes. The media editor 264 populates the rate card 536 area in the 
database 200. The user interface 240 accesses the data in the rate card 536 area to generate statistical 
data. 

[0086] The extended advertisable information 538 area contains additional information about 

specific types of advertisables not readily captured in the taxonomy hierarchy. Specifically, this 
includes additional information related to Web sites and companies, such as company contact 
information, Web site, and media kit URLs. This information extends the usefulness of the system by 
providing additional information to the client 140 about probed entities. For example, a chent 140 may 
follow a hyperlink to company contact information directly from a system report. The media editor 
264 populates the extended advertisable information 538 area in the database 200. The Web fi-ont end 
250 accesses the data in the extended advertisable information 538 area to deliver value-added 
information to a client 140. 
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[0087] The advertising summary 540 partition of database 200 comprises database tables that are 
logically segmented into advertising statistics 542, data integrity 544, and advertising information 
summary 546 areas. 

[0088] The advertising statistics 542 area describes how often an advertisement appears on each 
Web site. The system calculates and stores the following statistics in this area. 

1 . The proportion of page views that display an advertisement to the total number of page view. 
The system determines this statistic by analyzing the probing records. 

2. The number of impressions that an advertisement received. The system determines this 
statistic by measuring traffic levels for the Web site using the site definition and traffic data, and 
multiplying that measurement by the proportion of page views calculated above. 

3. The amount of spending that an advertisement received. The system determines this statistic by 
applying the rate card information to the number of impressions that the advertisement receives 
calculated above. 

The statistical summarization system 230 populates the advertising statistics area 542 in the database 
200. The Web fi-ont end 250 accesses the data in the advertising statistics 542 area to report spending, 
impressions, and advertising rotation to the client 140. 

[0089] The data integrity 544 area contains in-depth information about statistical outliers and 
other potential anomalies resulting fi*om trend and time slice analyses. This automated monitoring and 
analysis guarantees that the system will contain accurate analysis data. In addition, the system uses real 
world advertising information, as an input to the system, to verify the accuracy of the analysis data. 
The data integrity analysis system, performed by the statistical summarization system 230, populates 
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the data integrity 544 area in the database 200. The operator 262 accesses the data integrity 544 area to 
detect potential errors and monitor general system health. 

[0090] The advertising information summary 546 area summarizes advertising information in a 
format that is compact and easy to distribute. The system extracts the data in this area from the 
advertising support data 530 partition. While the data is not as descriptive as the data in the advertising 
support data 530 partition, it provides the ability to quickly perform a precise query. The advertising 
support data 530 partition associates each advertisement with a company, product, or industry. If the 
system associates multiple advertisables of the same type with an advertisement, a single advertisable is 
chosen to summary those associates using an assignment priority system, as follows: 

1 . Advertisables associated with an advertisement using direct classification receive the highest 
possible priority, "M". 

2. Advertisables associated with an advertisement using location classification receive priority 
equal to the string length of the location prefix to which they are assigned, therefore, a long location 
prefix string will receive a higher priority than a short location prefix string. 

3. Advertisables associated with an advertisement using ancestral classification receive the priority 
of the assigned ancestor. 

4. The advertisement receives the highest priority advertisable in each type. 

5. When two ancestors having the same type and priority are assigned to an advertisement, a 
conflict occurs and must be corrected by the media editor 264. 

The statistical summarization system 230 populates the advertising information summary 546 area in the 
database 200. The Web front end 250 accesses the advertising information summary 546 area to 
generate reports for the client 140. 
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[0091] The following description discusses one embodiment of the database structure illustrated 
in Figure 5. This data model is encoded in an Oracle database. The table structure comprises three 
environments, the core schema, analysis schema, and front end. The core schema describes the back- 
end environment which allow the Cloudprober to direct live autonomous processes that continuously 
scour the Web noting advertising activity and operators and media editors for the present invention to 
direct, monitor and augment information provided by the Cloudprober. The analysis schema is the 
back-end environment that allows the advertisement sampling system, also known as OMNIAC, to 
apply rigorous data analysis procedures to information gathered from the Web. The front end schema 
assists a client of the present invention with accessing data, building database query strings, and 
generating reports. 

[00921 The database objects comprising the "core schema" are most frequently used by various 

components of the OMNIAC system. Code bases that rely on this schema include implementation of 
the back-end processes that pull advertisements from the Web. Additionally, database schemas utilized 
by other components associated with OMNIAC are composed of some or all of the tables in the core 
schema. The core schema is conceptually composed of four sub-schemas including advertising, 
advertisements, probing, and sites. The advertising sub-schema holds information about 
"advertiseable" entities along with which entities each advertisement is advertising. The 
advertisements sub-schema describes the advertisements that the system has located and analyzed. The 
probing sub-schema defines "when", "where", and "how" for the probing process. The sites sub- 
schema describes Web sites, including structural site definitions and rate card information, 

[0093] Of the four sub-schemas, Advertising serves the most general purpose and is therefore the 

most frequently referenced. The primary table in this sub-schema is ADVERTISABLE, which defines 
advertisables. Many of the conceptual entities in OMNIAC's universe are advertisables: industries, 
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companies, products, services and Web sites are all defined here. The type field, referencing the 
ADVERTIS ABLE_TYPE table, differentiates between different types of advertisables, and the parent 
field organizes records hierarchically, establishing such relationships as industry-contains-company and 
company-produces-product. 

[0094] In addition to the inherent grouping implied by the parent-child relationship defined in 

ADVERTISABLE, ADVERTISABLE_GROUP_MEMBER is used to fiirther group advertisables. 
Examples of groups defined in this way include automotive classes, travel industry segments, and types 
of computer hardware. 

[0095] Other tables in the Advertising sub-schema serve to define what is advertised by each 

advertisement. ADVERTISES is used to associate advertisables directly with advertisements. 
LOCATION_ADVERTISES, CLASSIFIED_LOCATION and LOCATION_MATCHES also 
indirectly associate advertisables with advertisements via the advertisement's destination location. 

[0096] "Advertisements" referred to above are references to records in AD, the primary table in 

the Advertisements sub-schema. The Advertisements sub-schema serves to define each advertisement 
in OMNIAC's universe. Every unique advertisement has a record in AD, along with one or more 
records in AD_DEFINITION. Advertisement definitions are unique XML firagments OMNIAC has 
retrieved fi-om the Web. Ads are unique advertisements defined by sets of advertisement definitions 
determined to be equivalent during automated classification. 

[0097] Other tables in Advertisements contain advertisement attributes, referenced by AD and 

AD_DEFINITION. AD_TECHNOLOGY describes known Web technologies used to render 

advertisements, while TEXT describes textual content for certain advertisements. 

FUZZY_WEB_LOCATION contains fiizzy locations found in advertisements. A fiizzy location is a 

URL that needs to be processed by the system, such as an anchor or image. Once OMNIAC has loaded 
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a fuzzy location, a reference is made to MIME_CONTENT if the URL references an image, or 
DEST_WEB_LOCATION if the URL references another HTML page. 

[0098] Moving on, the Probing sub-schema controls the behavior of OMNIAC's probing and 

advertisement extraction components. The primary purpose of this schema is to define target sets. A 
target set is a conceptual construct that instructs OMNIAC to fetch a set of pages at certain intervals, 
extracting advertisements using a set of rules called extraction rules. Each target set is defined by a row 
in TARGET_SET. 

[0099] The frequencies, locations, and extraction rules that make up each target set are defined 

in STROBE, AD_WEB_LOCATION, and EXTRACTION_RULE, respectively. The many-to-many 
relationships between rows in these tables are defined in TS_RUNS_AT, TS_PROBES, and 
TS_APPLIES. 

[0100] The fourth and final sub-schema is Sites, which simply records information about Web 

sites. Each site or subsite defined in the advertisable hierarchy has a corresponding record in 
SITE_INFO, along with a number of rows in SITE_DOMAIN and SITE_MONTHLY_DATA. 
SITE_DOMAEN describes the physical structure of a site in terms of inclusive and exclusive URL 
stems. SITE_MONTHLY_DATA records advertising rate cards, third party traffic estimates, and cache 
statistics for each site on a monthly basis. 

[0101] The analysis schema is an extension to the core schema that includes a number of 

additional tables populated by OMNIAC's analysis module. The analysis module is the unit in charge 
of processing information held in the core schema, producing a trim dataset that accurately describes 
advertising activity. 
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[0102] Like the core schema, the analysis schema is composed of four conceptual sub-schemas 

composed of tables implementing common functionality. These sub-schemas include advertising 
decomposition, advertisement view summarization, slot statistics, and site statisitics. The advertising 
decomposition sub-schema holds information about each advertisement in the system, including 
attributes and what the advertisement is advertising. The advertisement view summarization sub- 
schema summarizes advertisement views, recording how many times each advertisement was seen in 
each slot over the course of a day. The slot statistics sub-schema describes advertisement rotation for 
each slot during each time period. The site statistics sub-schema describes site information, including 
advertisement rotation for each time period. 

[0103] The primary table in the Advertising Decomposition sub-schema is AD_INFO, which 

contains de-normalized records describing advertisement attributes. AD_INFO records are keyed off of 
ID'S in the AD table; an AD_INFO record exists for each AD record that has been completely classified 
and represents a valid advertisement. AD_INFO is populated by the analysis module fi*om the 
advertising relationships described in the core schema tables ADVERTISES and 
LOCATION_ADVERTISES. 

[0104] Fields in AD_INFO that specify what is advertised by an advertisement are: 

CATEGORY (industry), ORGANIZATION (company), ORGANIZATION_GROUP (industry 
segment), ORGANIZATION_OVERGROUP, COMMODITY (product/service), 

COMMODITY^GROUP (product/service segment), COMMODITY_OVERGROUP, and MESSAGE. 

[0105] AD_INFO also includes fields describing a number of non-advertising attributes. 

FORMAT, referencing AD_SLOT_TYPE.ID, specifies the form factor of an advertisement. 

TECHNOLOGY, referencing AD_TECHN0L0GY2.ID, specifies the technology used to implement the 

advertisement. DEFINITION, IMAGE, and DESTINATION specify the AD_DEFINITION, IMAGE, 
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and DEST_WEB_LOCATION records associated with the advertisement. These three fields mirror 
fields in the AD table. 

[0106] The Advertising Decomposition schema contains a few tables in addition to AD_INFO. 

[0107] ADV_IMPLICATION is a cache of advertisable implications derived from the hierarchy 

in ADVERTISABLE. This is used to speed operation of the analysis module. 
AD_INFO_FLATTENED is a more readily queried version of AD_INFO containing 

[0108] advertisement/advertisable pairs for each of the fields in AD_INFO that reference 

ADVERTISABLE. Finally, AD_TECHN0L0GY2 describes advertisement technologies understood 
by the analysis module that are presentable to the user in the fi-ont end. 

[0109] The Advertisement View Summarization sub-schema covers the single table 5 

PLACEMENT_SUMMARY. PLACEMENT_SUMMARY is keyed off of day, advertisement, and 
slot, and contains, in the CNT field, the number of times an advertisement was seen in a slot on a 
particular day. 

[0110] The analysis module populates PLACEMENT_SUMMARY by aggregating hits 

recorded in the APD_n tables, one of which exists for each day, n being the ED of the day in question. 
These tables are created and populated by the back-end as advertisement hits flow into the system. 

[0111] The third sub-schema in the Analysis schema is Slot Statistics. This sub-schema 

describes advertisement behavior in the context of slots in addition to information about the slots 
themselves. A slot is a location on the Web in which advertisements rotate, currently defined in terms 
of the location ID (a reference to AD WEB LOCATION.ID) and extraction rule ID (a reference to 
EXTRACTION RULE.ID). 
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[0112] The primary table in the Slot Statistics is SLOT_AD_VIEWS, which records the total 

views and relative frequency for each advertisement in each slot during each time period. The 
primary key of this table is composed of the fields PERIOD_TYPE, PERIOD, LOCATION_ID, 
RULE_ID and AD_ID. Two fields exist outside of the primary key: CNT holds the total nimiber of 
advertisement views, and FREQUENCY holds the relative fi-equency. 

[0113] Also in this sub-schema is SLOT_SUMMARY, which records general slot 

information outside the context of individual advertisements. Accordingly, this table is keyed off the 
PERIOD_TYPE, PERIOD, LOCATION_ID and RULE_ID fields. The CNT field records total 
advertisement views in the slot; this field is divided into the SLOT_AD_VIEWS.CNT to determine 
relative frequency. Also in SLOT_SUMMARY is a SLOT_TYPE field that specifies the type of 
advertisement seen most frequently in the slot, and SITE_ID, which specifies which site the slot 
resides within. 

[0114] The final table in the Slot Statistics sub-schema is SLOT_TYPE_COUNT. This table 

is used to determine which value to use in SLOT_SUMMARY.SLOT_TYPE. The number of times 
each advertisement format was seen is recorded, and the slot type that receives the most views is stuck 
into SLOT_SUMMARY.SLOT_TYPE. 

[0115] Figure 6 is a functional block diagram of the advertising prevalence system 130. 

Memory 610 of the advertising prevalence system 130 stores the software components, in accordance 
with the present invention, that analyze traffic data on the Internet 100, sample the advertising data 
from that traffic data, and generate summarization data that characterizes the advertising data. The 
system bus 612 connects the memory 610 of the advertising prevalence system 130 to the 
transmission control protocol/internet protocol ("TCP/IP") network adapter 614, database 200, and 
central processor 616. The TCP/IP network adapter 614 is the mechanism that facilitates the passage 
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of network traffic between the advertising prevalence system 130 and the Internet 100. The central 
processor 616 executes the programmed instructions stored in the memory 610. 

[0116] Figure 6 shows the functional modules of the advertising prevalence system 130 

arranged as an object model. The object model groups the object-oriented software programs into 
components that perform the major functions and applications in the advertising prevalence system 
130. A suitable implementation of the object-oriented software program components of Figure 6 may 
use the Enterprise JavaBeans specification. The book by Paul J. Perrone et al., entitled "Building Java 
Enterprise Systems with J2EE" (Sams Publishing, June 2000) provides a description of a Java 
enterprise application developed using the Enterprise JavaBeans specification. The book by Matthew 
Reynolds, entitled "Beginning E-Commerce" (Wrox Press Inc., 2000) provides a description of the 
use of an object model in the design of a Web server for an Electronic Commerce application. 

[0117] The object model for the memory 610 of the advertising prevalence system 130 

employs a three-tier architecture that includes the presentation tier 620, infrastructure objects partition 
630, and business logic tier 640. The object model further divides the business logic tier 640 into two 
partitions, the application service objects partition 650 and data objects partition 660. 

[0118] The presentation tier 620 retains the programs that manage the interface between the 

advertising prevalence system 130 and the client 140, account manager 260, operator 262, and media 
editor 264. hi Figure 6, the presentation tier 620 includes the TCP/IP interface 622, the Web front 
end 624, and the user interface 626. A suitable implementation of the presentation tier 620 may 
use Java servlets to interact with the client 140, account manager 260, operator 262, and media editor 
264 of the present invention via the hypertext transfer protocol ("HTTP"). The Java servlets run 
within a request/response server that handles request messages from the client 140, account manager 
260, operator 262, and media editor 264 and return response messages to the client 140, account 
manager 260, operator 262, and media editor 264. A Java servlet is a Java program that runs within a 
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Web server environment. A Java servlet takes a request as input, parses the data, performs logic 
operations, and issues a response back to the client 140, account manager 260, operator 262, and 
media editor 264. The Java runtime platform pools the Java servlets to simultaneously service many 
requests. A TCP/IP interface 622 that uses Java servlets that functions as a Web server that 
communicates v^ith the client 140, account manager 260, operator 262, and media editor 264 using the 
HTTP protocol. The TCP/IP interface 622 accepts HTTP requests from the client 140, account 
manager 260, operator 262, and media editor 264 and passes the information in the request to the visit 
object 642 in the business logic tier 640. Visit object 642 passes result information returned from the 
business logic tier 640 to the TCP/IP interface 622. The TCP/IP interface 622 sends these results 
back to the client 140, account manager 260, operator 262, and media editor 264 in an HTTP 
response. The TCP/IP interface 622 exchanges data with the Internet 100 via the TCP/DP network 
adapter 614. 

[0119] The infrastructure objects partition 630 retains the programs that perform 

administrative and system fiinctions on behalf of the business logic tier 640. The infrastructure 
objects partition 630 includes the operating system 636, and an object oriented software program 
component for the database management system ("DBMS") interface 632, administrator interface 
634, and Java runtime platform 638. 

[0120] The business logic tier 640 retains the programs that perform the substance of the 

present invention. The business logic tier 640 in Figure 6 includes multiple instances of the visit 
object 642. A separate instance of the visit object 642 exists for each client session initiated by either 
the Web front end 624 or user interface 626 via the TCP/IP interface 622. Each visit object 642 is a 
statefiil session bean that includes a persistent storage area from initiation through termination of the 
client session, not just during a single interaction or method call. The persistent storage area retains 
information associated with either the URL 114, 116, 118 or the client 140, account manager 260, 
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operator 262, and media editor 264. In addition, the persistent storage area retains data exchanged 
between the advertising prevalence system 130 and the traffic sampling system 120 via the TCP/IP 
interface 622 such as the query result sets from a database 200 query. 

[0121] When the traffic sampling system 120 finishes collecting information about a URL 

1 14, 1 16, 1 18, it sends a message to the TCP/IP interface 622 that invokes a method to create a visit 
object 642 and stores information about the connection in the visit object 642 state. Visit object 642, 
in turn, invokes a method in the traffic analysis application 652 to process the information retrieved 
by the traffic sampling system 120. The traffic analysis application 652 stores the processed data 
fi"om the anonymity system 310 and probe mapping system 320 in the traffic analysis data 662 state 
and the database 200. Figures 7A and 7B describe, in greater detail, the process that the traffic 
analysis application 652 follows for each URL 114, 116, 118 obtained firom the traffic sampling 
system 120. Even though Figure 6 depicts the central processor 616 as controlling the traffic analysis 
application 652, it is to be understood that the fimction performed by the traffic analysis application 
652 can be distributed to a separate system configured similarly to the advertising prevalence system 
130. 

[0122] After the traffic analysis application 652 processes a URL 1 14, 116, 118 identified by 

the traffic sampling system 120, the visit object 642 invokes a method in the advertising sampling 
application 654 to retrieve the URL 114, 116, 118 fi-om the Web site 110. The advertising sampling 
application 654 processes the retrieved Web page by extracting embedded advertisements and 
classifying those advertisements. The advertising sampling application 654 stores the data retrieved 
by the Web page retrieval system 322 and processed by the Web browser emulation environment 324, 
advertisement extractor 326, and the structural classifier 328 in the advertising sampling data 664 
state and the database 200. Figures 7A, 7C, 7D, and 7E describe, in greater detail, the process that the 
advertising sampling application 654 follows for each URL 114, 116, 118 identified by the traffic 
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sampling system 120. Even though Figure 6 depicts the central processor 616 as controlling the 
advertising sampling application 654, a person skilled in the art will reahze that the processing 
performed by the advertising sampling application 654 can be distributed to a separate system 
configured similarly to the advertising prevalence system 130. 

[0123] After the traffic analysis application 652 and the advertisement sampling system 654 

process the URL 114, 116, 118 identified by the traffic sampling system 120, the visit object 642 
invokes a method in the statistical summarization application 656 to compute summary statistics for 
the data. The statistical summarization application 656 computes the advertising impression, 
spending, and valuation statistics for each advertisement embedded in URL 114, 116, 118. The 
statistical summarization application 656 stores the statistical data in the statistical summarization 
data 666 state and the database 200. Figure 7F describes, in greater detail, the process that the 
statistical summarization application 656 follows for each URL 114, 116, 118 identified by the traffic 
sampling system 120. Even though Figure 6 depicts the central processor 616 as controlling the 
statistical summarization application 656, a person skilled in the art realizes that the function 
performed by the statistical summarization application 656 can be distributed to a separate system 
configured similarly to the advertising prevalence system 130. 

[0124] Figure 7 A is a flow diagram of a process in the advertising prevalence system 130 

that measures the value of online advertisements by tracking and comparing online advertising 
activity across all major industries, channels, advertising formats, and types. Process 700 begins, at 
step 710, by sampling traffic data fi*om the Internet 100. Figure 7B describes step 710 in greater 
detail. Step 720 uses the sampled traffic data fi:'om step 710 to perform site selection, and define and 
refine site definitions for the advertising prevalence system 130. Step 730 uses the result of the site 
selection and definition process to generate a probe map based on the sampled traffic data. Figure 7C 
describes step 730 in greater detail. Step 740 uses the probe map fi*om step 730 to visit the Internet 
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100 to gather sample data from the probe sites identified in step 730. Figure 7D describes step 740 in 
greater detail. For each URL retrieved in step 740, step 750 extracts the advertisements from the 
URL, step 760 classifies each advertisement, and step 770 calculates the statistics for each 
advertisement. Figures 7E and 7F describe, respectively, steps 760 and 770 in greater detail. Finally, 
process 700 performs data integrity checks in step 780 to verify the integrity of the data and analysis 
results in the system. 

[0125] Figure 7B is a flow diagram that describes, in greater detail, the process of sampling 

traffic data from Figure 7A, step 710. Process 710 begins in step 71 1 by gathering data from a Web 
traffic monitor such as the traffic sampling system 120. Process 710 strips the user information from 
the data retrieved by the Web traffic monitor in step 712 to cleanse the data and guarantee the 
anonymity of the sample. For each URL in the cleansed sample, step 713 measures the number of 
Web page views observed in the traffic data. Step 714 completes process 710 by statistically 
extrapolating the measured number of Web page views in the sample to whole universe of the Internet 
100. 

[0126] Figure 7C is a flow diagram that describes, in greater detail, the process of generating 

a probe map based on sampled traffic data from Figure 7A, step 730. Process 730 begins in step 731 
by analyzing a subset of the sample traffic data that falls within eligible site definitions. Following 
the analysis in step 731, step 732 builds an initial probe map based on the sample traffic data. Step 
733 analyzes the historic advertisement measurement results in the database 200 for the URLs in the 
initial probe map. Step 734 uses these historic results as well as system parameters to optimize the 
sampling plan. Step 735 completes process 730 by monitoring the sample results and adjusting the 
system as necessary. 

[0127] Figure 7D is a flow diagram that describes, in greater detail, the process of probing 

the Internet to gather sample data from Figure 7 A, step 740. Process 740 begins in step 741 by 
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fetching a Web page from the Internet 100. The Web page from step 741 is passed to a Web browser 
emulation environment in step 742 to simulate the display of that Web page in a browser. This 
simulation allows the advertising prevalence system 130 to detect advertisements embedded in the 
Web page. These advertisements may be embedded in JavaScript code, Java applet or servlet code, or 
common gateway interface code such as a Perl script. In addition, the simulation in step 742 allows 
the advertising prevalence system 130 to detect dynamic and interactive advertisements in the Web 
page. After the simulation in step 742, step 743 extracts the advertisement data from the Web page 
and step 744 stores the advertisement data in the database 200. Step 745 determines whether process 
740 needs to fetch another Web page to gather more sample data. In the preferred embodiment, 
process 740 continuously samples Web pages from the Internet 100. A person skilled in the art 
realizes that the functionality performed by step 745 can be associated with a scheduling system that 
will schedule the probing of the Internet 100 to gather the sample advertising data. 

[0128] Figure 7E is a flow diagram that describes, in greater detail, the process of classifying 

the advertising data from Figure 7A, step 760. Process 760 begins the analysis of advertisement 
fragments in step 761 by determining whether the fragment is a duplicate. When the advertising 
prevalence system 130 encounters an advertisement fragment for the first time, step 762 analyzes the 
internal structure of the fragment. Following step 762, or when step 761 determines that the 
advertisement fragment is a duplicate, step 763 retrieves the external content of the advertisement 
from the Web page. Step 764 then compares the external content to previously observed 
advertisements. Step 765 analyzes the result of the comparison in step 764 to determine whether the 
advertisement is a duplicate. When the advertising prevalence system 130 encounters an 
advertisement for the first time, step 766 begins processing the new advertisement by recording the 
structure of the new advertisement in the database 200. Step 767 then performs automated 
advertisement classification and stores the classification types in the database 200. Step 768 
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completes processing of a new advertisement by performing human verification of the advertisement 
classifications. Follov^ing step 768, or when step 765 determines that the advertisement is a duplicate, 
step 769 updates the advertisement viewing log in the database 200 to indicate the observation of the 
advertisement. 

[0129] Figure 7F is a flow diagram that describes, in greater detail, the process of calculating 

advertising statistics from Figure 7A, step 770. Process 770 begins the calculation of the advertising 
statistics in step 771 by summarizing the advertising measurement results. In step 772, process 770 
uses the probe map generated in step 730 to weight the advertising measurement results. The 
advertising frequency is calculated in step 773 for each Web page request. Step 774 uses the sample 
traffic data from step 710 and the advertising frequency from step 773 to calculate the advertising 
impressions for each advertisement. Step 775 completes process 770 by calculating the advertisement 
spending by combining the advertising impressions from step 774 and the rate card data input by the 
media editor 264 with the rate card collection 348 module of the user interface 240. 

[0130] Although embodiments disclosed in the present invention describe a fiiUy functioning 

system, it is to be understood that other embodiments exist which are equivalent to the embodiments 
disclosed herein. Since numerous modifications and variations will occur to those who review the 
instant application, the present invention is not limited to the exact construction and operation 
illustrated and described herein. Accordingly, all suitable modifications and equivalents which may 
be resorted to are intended to fall within the scope of the claims. 
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